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DETAILED ACTION 

This is a First Office Action for application no. 10/608,363 filed on June 26, 2003 
wherein claims 1-25 are presented for examination. 

Claim Objections 

Claim 21 objected to because of the following informalities: The claim states 
"wherein the tilt angle of said cameras is adjusted by tilt for each camera can be 
calibrated". The Examiner is unable to determine what the Applicant is attempting to 
state. Appropriate correction is required. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

Claims 1-3, 5-9, 13, 14, 17, 19, 20, 22, and 23 are rejected under 35 
U.S.C. 102(b) as being anticipated by US Patent 6,128,143 to Nalwa. 
[claims 1, 7, 13] 

As shown in Figures 2 and 7, Nalwa teaches a camera system comprising an N- 
sided reflective surface (40) and N cameras (52,54,56 and 58) (Col 3 Lines 53-63). 
Nalwa further teaches the cameras are aligned so that they have the same virtual 
center (Col 4 Lines 1 1-38). Nalwa further teaches the use of an image stitcher (Mux 
170 in Figure 7) for stitching each of said reflected images taken by adjacent cameras 
together to create a panoramic image (Col 6 Lines 1 -21 ). 
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[claims 2, 3, and 19] 

As shown in Figure 2, the cameras are tilted upward (90 degrees) relative to the 
horizontal to capture an increased vertical field of view. Nalwa further teaches the tilted 
cameras and mirrors in order to provided a 360 degree view of a scene as required by 
claim 3 (Abstract, Col 4 Lines 3-38). 
[claims 5 and 20] 

Nalwa further teaches the use of a mounting rod as shown in Figures 17-1 9. 
Figures 18 and 19, teach the mounting rod positioning said N-sided reflective surface 
above said N cameras each associated with a different side of said N-sided reflective 
surface (Col 1 1 Line 54-Col 12 Line 26). 
[claim 6] 

As shown in Figures 14 and 18, Nalwa teaches the positioning said N-sided 
reflective surface above said N cameras increases said vertical field of view of said N 
cameras (Col 10 Lines 1-6). 
[claims 8, 9 and 17] 

Nalwa further teaches the calibrating of the surface using a constant depth (Col 
1 2 Line 47-Col 1 3 Line 4, Fig. 21 ). Nalwa teaches the use of the predefined test pattern 
(930 in Figure 21) for the calibrating as required by claim 9. 
[claim 14] 

Nalwa further teaches the cameras are image gathering devices such as an 
optical scanner (Col 3 Lines 62-63). 
[claim 22] 
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Nalwa further teaches the use of a microcontroller for controlling the operation of 
the system (Col 6 Lines 1 3-1 8 and Lines 29-32). 
[claim 23] 

Nalwa teaches the cameras capture a 360 degree image (Abstract). 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claim 24 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nalwa. 
[claim 24] 

Nalwa teaches the requirements of claim 22, Nalwa further teaches providing a 
means of building a viewer which does not provided a full 360 degree viewing (Col 5 
Lines 45-51 ). It would have been obvious to one of ordinary skill in the art at the time of 
the invention to build a view with a total coverage of 180 as this is a coverage less then 
360 degrees (Official Notice). 

Claims 10 and 16 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Nalwa as applied to claims 8 and 13 above, and further in view of US Patent 
6,677,981 to Mancuso et al. 
[claims 10 and 16] 
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As shown above for claim 9, Nalwa teaches the use of a predetermined 
calibration surface (930 in Figure 21) (Col 12 Line 47-Col 13 Line 4, Fig. 21). Nalwa 
does not teach the use of a user defined calibration surface. 

Mancuso teaches a panoramic imaging system that provides the user the images 
and allows the user to define the calibration surface by determining how to combine the 
images (Col 8 Line 55-Col 9 Line 24, Fig. 4). It would have been obvious to one of 
ordinary skill in the art at the time of the invention to use the calibration process of 
Mancuso in place of the calibration of Nalwa in order to allow the user to determine how 
to produce the panoramic images. 

Claims 11, 12, 15, 18 and 25 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nalwa as applied to claims 8, 13 and 22 above, and further in view of 
US Patent 7,01 5,954 to Fonte et al. 
[claims 11 and 12] 

As shown above, Nalwa teaches the requirements of claim 8. Nalwa further 
teaches the images are a cylindrical arrangement which is displayed on a flat display 
(Col 2 Lines 16-Lines 28, Col 7 Lines 37-48, Figs 8 and 9). Nalwa does not teach the 
method of combining the images as claimed in claim 11. 

As shown in Figure 6, Fonte teaches the calibrating and image stitching of 
images obtained by multiple cameras in order to provide a seamless panoramic image 
(Col 9 Lines 4-1 9, Figs 6 and 7). The stitching includes the marking of the images 
(ABCD, Fig 7) and the creating of a mapping table to alter the images (Col 10 Lines 1- 
6). It would have been obvious to one of ordinary skill in the art at the time of the 
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invention to combine the stitching method of Fonte with the imaging means of Nalwa in 
order to provide a seamless stitching means as taught by Fonte. In regards to claim 12, 
Fonte specifically teaches the use of the mapping table for new images as once the 
table is determined the camera location does not change (Col 10 Lines 1-6). 
[claim 15] 

As shown above, Nalwa teaches the requirements of claim 1 3. Nalwa does not 
teach the use of table edges for defining the calibration surface. Fonte teaches the 
creating of a mapping table based on images input as shown above for claims 1 1 and 
12. Fonte further teaches the placing of the camera assembly on a conference table 
(Fig. 3). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to combine the stitching method of Fonte with the imaging means of Nalwa in 
order to provide a seamless stitching means as taught by Fonte. It would have further 
been obvious to one of ordinary skill in the art at the time of the invention that the 
images used to create the mapping table would include the table edges if the assembly 
was placed on the table as suggested by Fonte (Fig. 3) because the surrounds of the 
camera assembly would include the table, 
[claims 18 and 25] 

As shown above Nalwa and Fonte teach the requirements of claim 1 1 . Nalwa 
further teaches the requirements of claim 13. Nalwa is silent on the use of LED patterns 
for calibrating the cameras. Fonte teaches the calibrating of the cameras by using an 
LED pattern to determine image points viewed by multiple cameras and adjusting based 
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on these points (Col 17 Line 29-Col 18 Line 8). Note specifically Col 18 Line 5 where 
Fonte states the use of LEDs. Fonte specifically teaches the use of such a calibration in 
order to overlap images (Col 1 7 Line 29-30). It would have been obvious to one of 
ordinary skill in the art at the time of the invention to use the calibration of Fonte with the 
system of Nalwa in order to provide a panoramic image as taught by Fonte. 

Claims 4 and 21 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Nalwa as applied to claim 19 above, and further in view of US Patent 7,116,351 to 
Yoshikawa. 
[claim 4] 

As shown above, Nalwa teaches the requirements of claims 1 and 3. Nalwa is 
silent on the tilting of the cameras. Yoshikawa teaches a similar omnidirectional 
imaging device as Nalwa (Col 1 Lines 14-24, Fig. 1). Yoshikawa teaches the tilting of 
the cameras with an angle of less then 45 degrees in order to reduce the size of the 
imaging device (Abstract, Col 5 Lines 43-49 and Line 64-Col 6 Line 9, Fig. 3). It would 
have been an obvious to one of ordinary skill in the art at the time of the invention to 
combine the angled cameras of Yoshikawa with the imaging device of Nalwa in order to 
reduce the size of the imaging device as taught by Yoshikawa. It would have further 
been obvious to select an angle of the cameras at any angle below 45 degrees as a 
design choice with relation to the desired reduction in size of the imaging device, 
[claim 21] 

With respect to the objection above of claim 21 , as best understood by the 
Examiner Nalwa teaches the tilted upward of each camera as shown for the rejection of 
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claim 19 (Fig. 2). Yoshikawa teaches a similar design as shown in Figure 1. 
Yoshikawa further teaches an alternative embodiment wherein the camera and camera 
lens are tilted in order to reduce the size of the imaging device (Abstract, Col 5 Lines 
57-Col 6 Line 9). It would have been obvious to one of ordinary skill in the art at the 
time of the invention to use the teachings of Yoshikawa with the imaging device of 
Nalwa in order to provided an imaging device with a reduced size. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

US Patent 6,01 1 ,558 to Hsieh et al. 
US Patent 6,809,887 to Gao et al. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Erick Rekstad whose telephone number is 571-272- 
7338. The examiner can normally be reached on 8-5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on 571-272-7418. The fax phone 
number for the organization where this application or proceeding is assigned is 571 - 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 





